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Abstract 

We employ the variational formulation and the Euler-Lagrange 
equations to study the steady-state error in linear non-causal estima- 
tors (smoothers). We give a complete description of the steady-state 
error for inputs that are polynomial in time. We show that the steady- 
state error regime in a smoother is similar to that in a filter of dou- 
ble the type. This means that the steady-state error in the optimal 
smoother is significantly smaller than that in the Kalman filter. The 
results reveal a significant advantage of smoothing over filtering with 
respect to robustness to model uncertainty. 
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1 Introduction 



The appearance of steady-state errors is endemic in linear and nonlinear tracking 

systems and was extensively studied in control theory [5j. An important result from 

linear deterministic control theory is that the tracking properties of a closed-loop 

control system are determined by its type. The type of the system is defined as the 

number of pure integrators in the transfer function of the system within the closed 

loop. A type-n system can track a polynomial input of the form a- without 

[p-iy. 

any steady-state error for p < n, with constant steady-state error for p = n + 1, and 
cannot track the input signal for p > n + 1. This result is easily obtained using the 
final value theorem [5] from Laplace transform theory. 

Another result from estimation theory is that a Kalman filter [8] , designed for the 
n-th order model 

— — = ' = aw 

dt- (1) 
y = X + pi), 

where w{t) and v{t) are independent Brownian motions, results in a type-?7, closed- 
loop tracking system (as demonstrated below). Combining the above results and 
using the linearity of the Kalman filter, implies that a Kalman filter designed for the 
n-th order model ([T]) tracks the signal 

£W = ati; + a— (2) 
m! 

with constant steady state error for m = 0, and cannot track the input signal for 
m > 0. 

Although a steady-state error is a fundamental concept in tracking and control 
theory, the appearance of steady-state errors in non-causal estimators (smoothers) has 
never been addressed, despite the extensive study of linear and nonlinear smoothers 
in the literature [T2l|13l[T2[ini[IIl[3lllll5l[T6l[71[IIl[T]. The purpose of this paper 
is to fill the gap in the theory and to give a complete description of the steady-state 



error regime in linear smoothers. Specifically, we compute the steady-state error in 
the linear minimum mean square error (MMSE) smoother, designed for the model 
([T]). We show that the steady-state error in the smoother is similar to that in the 
corresponding filter of double the type. Questions of convergence and stability of 
fixed interval smoothers were considered recently in [6]. 

2 Mathematical preliminaries 

We begin with the general linear signal and measurement model 

X = Ax + Gw 

(3) 

y = Hx + Bi), 

where w{t), v{t) are orthogonal vectors of independent Brownian motions. The 
minimum mean square estimation error (MMSEE) or maximum a-posteriori (MAP) 
estimator x{-) of x{-), conditioned on the measurement y{-), is the minimizer over 
all square integrable functions u of the integral quadratic cost functional [31 [2] 

r [{y - Hzf{BB^)-\y - Hz) + u^u] dt, (4) 
Jo 

subject to the equality constraint 

z = Az + Gu, (5) 

where [0,T] is the observation interval. Note that the first term in (jlj) represents the 
energy of the measurements noise associated with the test function z{-), while the 
second term represents that of the driving noise associated with z{-). Note further 
that the integral in (jl]) contains the white noises v{t), which are not square 

integrable. To remedy this problem, we proceed in the standard way [4J by beginning 
with a model in which the white noises w{t), v{t) are replaced with square integrable 
wide band noises, and at the appropriate stage of the analysis, we take the white 
noise limit. 



The Euler-Lagrange (EL) equations [H] for the minimizer x = x{t\T) of the 
problem (jlj), ([5]) are 

A = -2H^{BB^)-^Hx{t\T) - A^\ + 2H^{BB^)-^y{t), 

with the boundary conditions 

x{0\T) = Xo, A(T)=0. (7) 

Thus, the estimation problem is reduced to a linear two-point boundary-value prob- 
lem, which is solved in closed form by the sweep method. Specifically, first the signal 
is filtered causally by the Kalman filter x{t), satisfying 

5;(t) = Ax{t) + PH^{BB^)-^[y{t) - Hx{t)], (8) 

and P{t) is the covariance matrix, satisfying the Riccati equation 

P = AP + PA^ + GG^ - PH^{BB^)^HP. 



Then the smoother x{t\T) is the backward sweep of the Kalman filter, 
dx{t I T) 



dt 



(9) 



(10) 



Ax{t I T) + GG'^p-^[x{t I T) - x{t)l 
with the boundary condition 

x{T\T) = x{T). (11) 

We continue with the steady-state error regime in the Kalman filter designed for 
the n-th order model ([T]). Rewriting ([T]) in vector matrix notation leads to 



x 



Ax + abw 

h^x + pi), 



(12) 
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The Kalman filter estimator x{t) = [x{t), X2{t), . . . , Xn{t)]'^ for tlie model fll2p satisfies 
(see equation ([8]) 

^{t) = Ax{t) + k[y{t) - x{t)], (13) 

where k(t) = [ki{t), . . . , kn{t)]'^ = —P{t)h. The equation of the Kalman filter (|T3l) 

P 

may be rewritten in the form 

i{t) = X2{t) + h[y{t) - x{t)] 

in-l{t) = Xn{t) + kn-l[y - X{t)] (14) 
Xn{t) = kn[y-x{t)], 

which form a type-n closed-loop tacking system with input y{t), output x{t) and 
open-loop transfer function 

= + - + (15) 

Thus, the Kalman filter designed for the n-th order model ([1]) tracks the signal 

x(^)=aw + a— (16) 
m! 

with constant steady state error for m = 0, and cannot track the input signal for 
m > 0. The the terminology offset case m = of filtering theory is kept also for 
smoothing. 

3 Steady-state errors in smoothers 

Having described the steady-state error phenomenon in the Kalman filters, we con- 
tinue with the evaluation of the steady-state errors in smoothers. We assume that a 
linear smoother is designed for the n-th order signal model ([1]), for which the Kalman 
filter was designed in the previous section. In order to examine the tracking properties 
of the smoother, we assume that the incoming signal is augmented with a (n + m)— th 



order polynomial in t 

, . at"" 
x^'^' = — - + aw 

ml (^7) 

y = X + pi). 

For the sake of simplicity, we assume hereafter that a = p = \fe and x(0) = £(0) = 0. 



signal yif) can be separated into a deterministic term, depending on the drift 



The smoother is a linear system, so the response of the smoother to the measurement 

oT 
ml ' 

and a stochastic term depending on w{i\ vii). Because the steady-state error regime 
is determined by the deterministic term, we consider the noiseless version of ((1 

~(n) ^ ^ 



y = X. 

Using vector matrix notation, the smoother is designed for the model ( fT2l) and the 
equations for the smoothed estimate x{t \ T) ffTOj) . ([8]) are 

= Ax{t\T) + ^[y{t)-h^mT)], 5.(0) = ^^9^ 

'x{t\T)) = Ax{t\T) + bb^p-^[x{t\T)-x{t)], x{T\T) = x{T). 
Inspecting (1191) . we observe that the Kalman filter forms a feedback system with a 
type-n transfer function. Thus, the Kalman filter is capable of tracking a (p < n)-th 
order polynomial in t without a steady-state error, and a (p = n)-th order polynomial 
in t with a constant steady-state error. The backward equation for x{t\T) forms a 
feedback system tracking the output of the Kalman filter x{t) in reverse time and the 
transfer function is again of type-Ti, with tracking properties similar to these of x{t). 
An important feature of this forward-backward tracking system is that the tracking 
errors in the backward and forward equations have reverse signs. This qualitative 
observation may indicate that the steady-state error regime in the smoother is superior 
to that in the causal filter. 



With the above observations in mind, we turn to the quantitative analysis of 
the steady-state error in the smoother. We define the estimation error e{t\T) = 
x{t\T) — x{t) and use the expression flTHl) for the incoming signal, which we rewrite 



as 

xit) = Ax(t) + — -b 

(20) 

y{t) = h^x{t), 

where A, b and h are given in (fT2l) . Using the EL equations Qj, the equations for 
the estimation error are 

= Aeit\T)-hb^Xit)-^, e{0\T) = 
ot 1 ml ^21) 

X{t) = -2hh'^e{t\T) - A^X{t), A(T) = 0. 

Setting e(t\T) = [ei, . . . , e„]'^, A(t) = [Ai, . . . , An]^, the error equations (12T1) become 

Cfc = Cfc+i, ek{0\T) = for all 1 < k < n — 1 

at"" , , , 

— , e„(0|T) = 

^' (22) 
Ai(T) = 















Ai = 


-2ei, 


Afe = 





\f^(T) =0 for all 2<k< n. 

We seek a steady-state solution, such that = for all 1 < k <n. This implies 

1 at"" 

en = -7^A„ - = 0, 23 

2 ml 

hence 



An — T 

ml 



Using fl22|) , we have for all < < n — 1 

2(1 j^fn^l^^^ 

[-1)''^^7 ^ for all k<m-l 

Xn-.= { (rn-k-iy. ^24) 

for all k > m — 1. 



Using the fact that Ai = — 2ei, we obtain the steady-state solution for ei, whenever 



it exists, as 







for all 



m < n 



= < 




for all 



m = n 



(25) 



no steady-state solution for all 



m> n. 



This result implies that a smoother designed for a n-th order model is capable of 
tracking polynomial inputs of order up to 2?7, — 1, that is, for m = r?, — 1, without 
any steady-state error. Moreover, for a 2n-th order polynomial input (i.e., m = n) a 
constant steady-state error of magnitude \a\ appears. We conclude that the steady- 
state regime in a smoother designed for a n-th order model is similar to a causal filter 
designed for a 2n-th order model, as illustrated in Figures [H [2l 

The linearity of the smoother implies that the smoothing error variance induced 

at™- 

by the Brownian motions w{t), v{t) is not affected by the drift term — - in the signal 

ml 

model (fT7|) . Thus, the smoother exhibits superior steady-state error regime without 
any increase in the error variance, which remains smaller than that in the causal filter 
[7], as shown in Figure [3l 

The obtained steady-state error regime corresponds to an infinite interval < t < 
oo. Obviously, at the end of the interval [0, T] the smoothing solution x{T\T) is equal 
to the filtering solution x(T) (fT9l) . Thus, in the offset case (m = 0) the filter develops 
a constant steady-state error and the lag needed to eliminate the steady-state error 
by smoothing is the time constant of the system. In contrast, when m > and the 
causal filter error increases with time, the lag necessary to decrease the error to the 
values we obtained is much longer. 



4 Discussion and conclusions 



The results reveal a significant robustness of the smoother to signals different than 
those, for which the smoother is optimal. In many applications in engineering prac- 




Figure 1: The steady-state error in the first order smoother and filter with 
offset (n = 1, m = 0). No steady-state error develops in the smoother, while, 
the filter develops constant steady-state error. 
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Figure 2: The steady-state error of the first order smoother and filter with 

the polynomial input (n = 1, m = 1). The smoother develops constant 
steady-state error, while, the error in the filter is unbounded. 




Figure 3: The estimation error in the first order smoother and filter in the 
offset case. No steady-state error develops in the smoother and the error 
variance in the smoother remains smaller. 



tice, either there is no exact information about the signal, or the signal changes its 
characteristics with time. Thus, robustness of the system to the signal model is desir- 
able. The results further indicate that the performance gap between smoothers and 
filters with respect to the criterion of mean square error increases as the difference 
between the incoming signal and the nominal signal increases. 

The fact that a smoother, optimal for a n-th order signal, exhibits a steady-state 
error regime of a type 2n causal filter, without degradation in the error variance, is 
very appealing from the engineering point of view. This is due to the facts that in 
many applications lag estimation is possible and that linear smoothers are rather easy 
to implement, for example, by using approximate finite impulse response (FIR) non- 
causal filters. Utilizing smoothers to exploit their superior tracking properties may 
free the designer from the traditional trade-off that exists in causal filtering between 
steady-state error regime and error variance. 

Steady-state errors also appear in nonlinear estimators, as shown in nonlinear 
filtering [181 [IH] • An extension of the ideas demonstrated here to nonlinear smoothing 
will be given in a forthcoming paper. 
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